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MISSION 

* The mission of the Wisconsij^ Research and Development Center 
for Cognitive Lear^ning is to help learners develop as rapidly 
and effectively as' possible their potential as human beings 
and as C9ntributing member^ of society. The R&D Center is 
striving to fulfill this goal by ' ' 

• conducting research to discover ^more about * 
how children learji i ' * 

• developing improved instructional strategies^ 
processes and materials for school administrators, 
teachers, and children, and 

• offering assistance to educators and citizens . , 
^ ^^hich' will>help transfer the outcomes of research 

J cmd^evelopment into practife 



PROGRAM i 

The activities /Of the Wisconsin 1^ Center are organized 
around one^ unifying theme, Individually Guided Education. 
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ABSTRACT 



A' large scale, national mstructrional. materials support program for 
handicapped children was ijnitiated in 1964 by the Bureau of Education for 
^ the Handicapped and maintained for a period of ten years. Th'i^ program 
^ which was comprised of regional, state, and local instructional materials 
• centers provided a beginning base of knDwlfedt^e on the needs for, uses of, 
and priorities 'for instructional materials for use in teaching handicapped 
chilcfren. This paper reviews the knowledge base and provides ijisight and 
direction to future work in the area of materials evaluartion and selection 
fbr handicapped children, » 



INTRODUCTION 



'Since 1964, via thie natfionv/ide network of special education instruc- 
tional materials centers (IMCs) and learning resource centers (LRC^s) , a 
considerable effort has been made to provide teachers of the handj^.'capped 
with instructional materials and aids to assist them in their rol^. This 
effort hasseemingly been based on the premise that there is a direct re- 
lationship between the quality of instj^uction a child receives and the 
quali'^y of support (including instructional materi'als) that the teapher 
receives. Unfort\:^nately , the accuracy of this premise has nevet been wel 
tested and the myriad variables that affect this premise J^ve never been 
well identified, nor has their impact on the education oa handicapped ' ' 
children been .well documented. • • J - 

This study^^ though limited in scope, has addressed kevera*! questions 
related to teacher use of ' instructional ^materials , and other matters re- 
lated to special education learning resource centers as ^hey support the 
instructional efforts Of teachers of the handicapped.- Those -questions - 
are: . / * 

1. To what extent do teachers of the handicapped use the in- 
structional materials made available to.- them via special 

elation IMQs/LRCs? ' ; • ' " ' ^ 

2. What tnatei^ials, by name, are most frequently used by teachers 
Of the handicapped? - ' ^' ^ . 

3. '-What is- the extent of use oJe instructional ^naterials '.by sub- 

ject area?' , ' 

4. What is the extent of "use of instructional materials by 
handicapping condi:t:ion? What materials appear to be most 
appropriate fe^^-^arying handicapping conditions? 

5. How do teachers regard the? materials 'available to them* at 
the IMCs/LRCs? ' ' 

6. What factors influence teachers ' us-e of IMC/LRQ materials? 
. 7. What factors relate to and/or d^nfluence the puK'chas4 of 

instructional materials? . . - 



II 



METHOO 



tions 



Three major efforts h^ve been mad^^o. gather data on these ques- 




Measurement of teacl^er responses to the instructional materj. - 
als they xised . ""ietvJ^n 1400 and 1500 responses, from approxi-r 
mately 500 teachers of thfe handicapped, were gathered using the 
SEIMC Material^ Use Response Card ($ee Appendix A) .v ^ 
Teacher in terviews . Approximately 650 teachers of the handi- 
capped were interviewed (either in t>ersor\ or by phone) and, 
among other questions, were asked to identify those' materials 
hnd services of the IMCs and LRCs that they found to be most ^ 
valuable • (See Appendix B. This ihstriinent ha$ changed in for- 
mat' over Xhe years, but the ^cpntent has remained essentially 
the same) • 

On-sita eva^uati^,hs of IM^s/LRCs . Twenty-five IMC/LRC collec- 
tions were Studied, on-site using the Xbllectioh Monitoring 
Fprm (see Appendix C) . 



The data reported below were, gathered over a three and a half year 
period, and represent responses of teachers and special education IMCs/ 
LRCs in .Oregon/ Washington, California, ];daho, Wyoming, Alaska, Hawaii, 
The United Stated Trust Territory of the Pacific, Guam, and American 
SaTtba*. ' ' * . 





Ill ' 

RESULTS 



QUESTION 1: To^what extent do teachers of the handicapi/ed use tj/e in- 
structional ma1;erid-ls made available to tjiem via spfeciaT 
education IMCs/LRCsT ' • 




The variety, and differing adequacy oT the many record k^.eping systems 
in use at the different IMCs/LRCs make it extremely difficult to identify 
^precis^ly the extenj: to which^ teachers use , the iri^t'ruction^l materials 
available to them. Nonetheless, several "ballpark" figures have emerged 
and are reported here as having substantial va/idity and reliability. 



Use by Total Collection 



Generally, it- seems sa^e to a^Uh\e tj;iat 7Q perpeift to 80 perqent of , 
the materials of any randomly selected^ IMC/LRC collection will either, 
nevet be checked out in any giverf ^gar ,^/or will be checked out only onp€^. 




A surprising niomber, perhaps as hie 
tion will never have been checked out 
checked out over the last three -years 
tion of ma^terials not in f ifequent ^use . 



one^third, of any given collec- 
it all, or will never have been 
Table 1 details the disposi- 
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pir^POSITION OF MATERIALS 
NOT INyfREQU^NT USE 



Di^^siti 



tion pf Materials 



-i:^ 

Percent* 



Undesirable/unknown* to patroif^ 
^arts broken or missitig . , 
Out of date . 
Stolen or' lost ^ '[/ 
Highly specialized- / ^ • 
•Percent of ^otal collection; 



*TKese ;percenj:ages ab^ approkimations .based oh^ thq 



collect ions^vstud 







Use as* a .Function of ^ the ^ize of ' the Collect/ion ( . \ 

There appears- to be a direct relationship between t^ie size\of,the 
collection and the extent to which the irtat^rials within that coi^lection 
ar^ used. 

' As shown in figure 1, the- various coilections of m^aterials were 
distributed into ,f requency distributions according to^size; the smaller 
the collection, the larger 'the'^mean, pei/ , item use. 




Nurabei'" of Materials por Collection 



FiqurV t. Aiuiudl ust^ as*a function of the size of the cdl 



t 4 



0 

ERIC 



Upon studying Figure 1, one might logically, conclude that , given a 
.stable population of teachers, as th"fe collection increases in size, theV 
per-item use decreases since there' are more materials, from which to -^chpose. 
In. tha^ regard, two considerations seem worth mentioning, firsts it^ 
is unlikely that^the downward trendi would be. as. dramatic as that she 
.in Figure. 1,/arnd second, it is- interesting -to note that the number/of 
materials, and "the individual* materials checked Vut; do not change 
markedly with the size of the coll4^tion* In other' words^, "regardless ^of 
the size-of the -coll ec"t ion,. ^tl\e same ir^aterials atef'' cfie;,cked ouu/ and, they 
are' cheeked out with nearly the s^me frequei^cy (se| jy.gxire/2) . The ma-^or, 
factor Effecting tlie frecjuency with ,whidh materials are ;2rhe1cked',out 



/ f 



/ 



appear 'to be the characteristics of the materials, rather than .the 
number of materials available. This would indicate that the- $iie of ah 
instructional materials collection would be relatively unimportant so , * ^ 

- long as it cojitained those materials that tea'chers found useful. 

Parenthetically, it seems appropriate to note, that- regardle^ss of , 

"^the size o? the collection, a frequent suggestion (appeal?) of those 

interviewed has been that materials be purchased for: which ther e are. , 

data (at least teacher inputs) that verify that the' matez^^ls-^e'^e^ 

. lated to the specific need^ and abilities cif the children. 
• ' - . • 

QUESTION 2: .What materials, by' name, ara mpst frequently used by teachers 
of the, handicapped? • ' - J ' 

. ' : - • ' ' ^ . 

j\ Though' there may be sope-danger in identifying ma-terials by name, in- 
v^ti*gators feel ^ys^tif led in doing so given the. fact that a relatively 
sifcll number of- materials were repeatedly named by the interviewed teachers' 
as being the most popular a^d highly regarded. It must be emphasized that ^ 
no endorsement pf any product; material , author , or publishjsr^ is intended by 
~ this action. Al^o, it Should be noted that not ^ery tieacher ^nd not every 
IMC/LRC collection reflected ther findings reported below. Lastly,^ the vast 
majority of materials checked but by.Veachers were rated, high (see Question 5) 
regardless of their frequency- of use,^, - . . ^/ 



• Programs (Listed in rank order) , . - ' 

D.xSTAR • • • - • ' ^ r ^ ' 

Science Research Associates (SRA)' Basic. Reading Program / / • 

Bowmar* - . 

. Sullivan Behavioral Reseax*ch Laboratories (BRL) 
Peabody Language Deveiopq.ent. Kit (PLDK) 
> C^inn 100 Bas-ic Readers • ' • ^ : 

'"Systems 80 ** - 

Series ajid Skill Development - Materials (Listed ift rank order) 
Checkere'd Flag .Series ^ • ' * • ^ 

Tom Logan Series * ^ . , ' 

• Palo Alto Readers^ ^ ^ - ^ * 

SpjMngtio'ard Series ^ ^ • . • ^ ' ^* 

Gradfemaker-Mystery Series , * • ' , - \ . - \ 

o Target » - ^ 

^ Dan Frontier "Series, Jim Forest Series/ 'Sports ♦Close-upir, Cowboy Sam 



1 « - > • ^ - • -r 

. This list lacks specificity to the extent that ,an some instances materials,: 
\were identified *in rather 'broad 'terms* 'For example, "D^STAR" and "DLM** 
were frequently' me^^tioned, b,ut^he tea^cfiers* did-not/cquld not always identify '4 
the specific ftlSTAR or DLM it^ being ^sed. '-Further study, in this area," 'shoulj^ 



.adjdress this matter. 
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Aids to Reading and/Canguage I_nstruct^n -^(Listed • in rank order) 
DovelopnTen'tal Learning Materials (Di^ ' \ , 

Children * s Prt^ss Materials : * 

BelL a^d Hpw^^il Language Master 

Format * *' 



Teachers frequently indicated the need to use games and puzzles 
zo assist in reading and- language instruction and 'the need for 
high interest, low vocabulary reading materials (for girls as. 
well as boys ! ) . • 



Arithni^tic , * , . * • 

DISTAR was the most frequently c^ted arithmetic prograjn mentioned by 
name. Other arithmetic programs were mentioned' only infrequently.. * • 

DL.M ^materials were cited most often as aids to arithmetic instruction, 
and, as wi.th reading, games and puzzles were frequently mentioned as being^ 
useful and effective. * * 



Science 

The Biological Sciences CurriculumSiijeT^^SCS) Me Now kit was the t 
only repeatedly mentioned scien£.&.-^nscruction material. 




Materials 



The Frostig materials were most often mehtioni^d by name, wit:h the 
DLM materials being next. ^ ' . • 



>$ate-rials Commonly Mejitioned in ^he Various Collections 



The materials listed b< 
collect Lons .generally^, we 
being valuable: - i 




:ough not high frequency items in mat^^ 
r^ed by teachers from numerous centers a 



Reading and Langyage {Liat<^d.in random orde^) 
* Stanwix House \ 
Foll^t 
* Continental" Press 

McMillan Language Skill Seri€ 
' Lift-Off Series 

Laidlaw Language Series 
. Program" Builder 
Phonics We Use 
7^onte;ssori Materials 
^dmark Reading \ ^ . " ' 

^&a(l5>jational Developmental^ Laboratories (EDL) C*pntrolled Readers 
Tunctionar Basic Reading Series 
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Reatieir's Digest Readers 
Scott ¥'oresman' Readers ' 
' / ^Dolch Materials^ ' - * 

Pace Setters for Reading * . , » 

ts^Arithmetic (Listed in randoift. order) 
. Money Makes Sense 

Continental Pre^s Materials 
Montessori Materials m \ 



QUESTION 3: What is the extent, of (jse of instructidnal materials by 
subject* area? * ^ ^ ^ - ' ^ 

Here, again, precise figure^ are impossible to cite. The figures in 
Table 2 are approxiiAations , * but ifhe evidence Suggests that they are -generally 
accurate -^and. account for the variations th^t exist from center to center. 



.TABLE 2 

EXTENT OF USE OF INSTRUCTIONAL MATERIALS 
BY SUBJECT AREA . 



Subject Matt 



ea 



- Extent of -Use- ' 
« 

by. Percent 



'Reading and Langua^^'' 
Arithmetic \'> 
Social/ Studies 
Science * ; 

All Others 

Percent pf total collection 



55 to 65 
15^to 20 
10 'to 15 
5 

. 5 

90 to' no 



QUESTION 4: What Js the extent of^i^^^^^^^^^ materials by handi- 

^ capping conditio02;;::rlJfi^^ be most., appro- , 

, ' \ prlate^ for varying h&adicap{^ing, conditions? 

Except for -the visually and auditorily impaired, thfere does not appear 
^o' be any signif icatit " (or even casual) * relationship, between a giveA instruc- 
tional .material ar/a*a ^iven handicapping condition. What "works well" with ' 
a child <^*assif ied as Learning Disabled appears to "work" equally well with 
a child cdassified.as EMR (educable, mentally retarded). A child's 
handicap, jtherefore^r (with the exception cited above) appears' to have no 
bearing Whatever on. the selection of instructional material^ to be used in 
teaching that child ."^ Selecting appropriate instiTuctional materials ^eems. 
to be primaijily a matter of supporting instrucTtional efforts in the subject . 
matter areas rather than matching "^materials to unique characteristics^ Given 
the wopk of Armstrong 'il975) and Hj.rsch and Afqistrong (1975) , this area of 
concern appears to require '.substantially more* attention. 
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QUESTION 5: Kow do teachers regard the njaterials' available to them at the 
* ^MCs/LRCs? ' . * ^ . .. 

In describing the iastructional ma\:erials that they had borrowed from 
the IMCs/LRC^, 90,7 percent of the teachers recorded positive r^spons'^s, 
and 9.3 percent recorded negative responses, • - ' 

When asked yf they^would use the material again, 87.8 peJF^z^nt -said ^ ' 
they would, and 5.2 «2/percfent *s^aid they would not. When askfd if^he ^ 
materials they had* borrowed were as readily available to them through , 
sources other than the IMCs/LRCs , 92,5 percent of the teachers said no, 
and" 7.5 percent s^id yes. . ^ ' ' 

These responses suggest that IMC/LRC materials arg^enerally seen by 
teachers as' valuable, and that without the IMCs/LR^srTtheN^ateriWs would 
be less readily avaiiaqle for use in the classrpdms of the Handicapped, 



QUESTIONS-:.- What factor>-^lTf!uence ^teachers ' use of I'MC/LRC materials? 

, ' Although thefe^re undoubtedly othe'rs,'the factors cited below appear 
to be amonj the most important in influencing teachers* use of IMC/LRC 
collection's: , 



2,. 



Proximity . It/is' generally the case that the closer the 
center is. to the teache^rs , 'the'^more the materials will be 
used. (Nevertheless, it is not impcTssible to find situa- 
tions where teachers wqrjcing clo's'^e^to an IMC/LRC^-even in 
the same building — seldom, if everS^^avail themselves of 
the materials.) Figure 3 illustrateis^^e effect of prox- 
imity on the* utilization -ef a specia]L\edxie^t ion .instruc- 
tional materials, collection. Although\jhes^d^ta are 
regional in scope^ they appear to be repr^e^sentatiye of 
special-'^educ^ion collections generally, except in^i^iose 
sitUfitions wi^ere a stable materials delivery ^^stem is"^^^ 
♦ aval liable. . / - ^ , *X 

'"MateriaLs yeli^ry . In ti>e^ situations where mat^Xial^ 
are delivjftred to the t^^hers, frequency of uge typicaljy 
increasesr and ^proximity to the coll^l^on is less influen'K, 
tial.^ *TSn^ most successful delivea^^ystems appear to be.* 
tnese'''(4.Lsted in ora^ of prior.ity)'^: *^ (1) IMC/LRC staf^ 
In thijB sit:ua1:ion, mat^ials are personally deliv^x^dxo 
th^*^ tpach^r^ -Joy, members Okf the 'IMQ/LRC &fea-ffr'''''T2) Di-stric*' 
Cour/erv ^* School^ dJL&trictis^aften have a delivery service that 
vis/ts the. schools 6n a regul^i^ scheduled basis, usually 
at Aea*st weekly.* Mail. Thoubfiithis service is av%^^le 
tor everyone, costs o^tdrv^ar e ^ prohib itive. . ' 

fc/LftC Staff . Materials aresmbrelDcely^^t© be" used in 
i.tuatiqns where knowledgeable- o^ter^ st^ff are 'a'^ilai)^0i^ 
to help' teachers -^locate and selecq'^^terials ,. apd to' demon- 
strate their use. * 
Knowledge of' the collection > It is generally the case tha.£ 
the more aware teachers -'^are of the materials avail^ible^ tg.. 
them^ the 'mor^ likely^' tihey wiiX* be to avMl-rth^seives-of 
those materials. • r ' * ' * ^ v 
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Fijiuj^S. Northwest Special Education Inst;Ervict^nal Materials Center 
"^^^ materials collection utilization by '^reas served (the-SEIMC 

was lioufeed x>n- th6 campus of the University, of Oregon) ♦ . 
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Knowledge of the . individual materials . .The rate of materials 
•checkout appears to be a reflection of hoy familiar the 
te^ichers are withlthe materials Xi.e., how to use -them, for . 
wheet instruction mirpose to use them, etc.) 
. Manner by ' which master ia Is are . identified tfor inclusion in 
. the collection . Materials that are ^acquired arbitrarily, 
by IMC/LRC personnel ("catalog buying") appear \o get less 
use -than materials;! that* are suggested for purchase* by tho^e* 
who- will be t:^ing*tihem. There is ample evidence to suggest 
^ that it is wise to *^*con(3uct a inateriais needs/perceived needs 
assessment,' a^d then. purchase ^tqrial^ accordingly . (Never- 
thelessL, the ex,te'j^t\to which alhd^t any material is used is ' . 
delated to the ^extent to which tea^h^t^^ ari^^t^de aware of* 
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Promotron^al efforts . It may be unfortunate, bat teachers 
appear to "consyme" InstruotionaJ. materials in much the same 
way that they consume 4ny other 'goods or services (i.e,, How 
does it look? How does it make me look? * Who kas recommended 
it? etc.); Consequently, Center personnel who '"push" their 
materials tend to f inS their materials being used more fre- 
quently!. 

Access to the IMC/LRC > Collections jbhat are difficult ,to 
r^ach because of stairways, lack" of parking, rough walking 
surfa^ce's, etc., tend to be ias;ed less than those with easier 
abcess . , - » ' "^.^ • 

IMC/LRC facilities . Mater^ials tend to get .used more' fre- 
quently Uhen the'y are housed in facilities that have -^tiequate 
shelving, browsing ±oom, preview 'space, lighting, and tem- 
perature control. , ' 
Availability and condi<:ioi^ of materials , teachers tiend to 
Ipse inteifest ^n^Us-ing IMC/LRC mate3Mals if .they repeatedly 
have- trouble l^cating/acquirinV 'the materials they want, or,, 
once located/acquired, * find the material to be unusable d\ife 
to damage or mi&sing parts. ' . " * 
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QUESTION 7: /Wha-t factors relate to and/or influence the purchase, of 
instructional materials? 



Several factors emerged which appear to relate to and/or influence 
the^purchase of instructional .materials for, ^n IMC/LRC collection. Several 
were obvious, such as the avarila}?ility of funds, instruction^ 3:iee<3s'^ and 
•awareness oi IMC/LRC staff of materials available for purchase. A less 
obvious fac,tor, however, is detailed *in Figure 4^ the per-item cost of in- 
structional'^aterials,,as a .function pf the size of the collection. Al- 
though this -^is an area that needs further study, thfere is treason to 
believe tha^ the per-itera costs for small collections (which are usually 
the rfewer collection^) are substantially greater than the per-item costs * 
for larger collections. (which usually have been in existence for some / 
time) . • ' ^ * ' ^ 

No definitive data have emerged to explain the costs-per-item dif- 
.^erential^^s a function the size and age of collections,. However, 
a perusal of several acquisition r.ecords revealed that in many cases 
materials collections apparently originated as a xesult of the sudden . . 
avaalability of a substantial amount of money, meUcing it possible to 
purchase 'mfcre expensive *ma±erials at the outset* This appeared to be 
followed by the purchase* of 4ess' expensive support/enrichment/variety 
materials. In time, however, as rtfaterialb began to experience "wear . 
and tear," replacement costs (and probaQ^ly inflation) tended to d^ive up 
the per-Ltem costs. It i^ hoped that this analysis, though admittedly . • 
simplistic-, may give same direction to further study dn thi9^^aJ^fea. 



CONCLUSION. 



Teacher us^ of» Instructional 'materials ^is a subject thpit^is in* need 
' of considerable study. Certainly, frequency* of use'^is not an exclusively 

^-"^ vietble measure of the appropriate use of instructional jnaterials . It is 

-possible th^t day in and day ' out great numbers of instructional mcjterials 
are poorly and/inappropriately' used'^with handicapped as 'well as "regular" 
students. . * • .* . ♦ 

In f)ursuit' of more functional' knowledge , thi,s investigator suggests » 
•that studies^ be conducted that ar^ addressed to vi<4entifying ^and then 
matching* appropriate instructional* mater ial§ to specific^ learner heedS/.^ 
Such knowledge, in the hands ot trained and competent teachers , would' 
bertainly bear a -^eater imps^ct onithe educatio^i of handicapped 'children 
than would the simple Availability .of leurge n\ambers of instructional / 
\^ materials brightly pack^iged and neatly shelved.^ u/, 
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Trying to evaluate instructional/materials as "good'' or ''bad'', 
''effective!' or "ineffective*' iox instructional purpfoVes is .proposed^ • 
to baan imjy-actical effort given.existing- evaluation techniques. 



As an alternative, ^measuring and reporting teachers] responses 
to the instructional mater;t^ls they use is prqposed. -Suggested 
procedures and instrun^/ntatian to do so*- are described. ] ' ' " 



, MEASURING TEACHER RESPONSES'. - 

_.Vv/.' ^ '^o INSTRUC;T10kAL--MATERIALS' ■ 



The evaluation o£. instru'ctional materials has been a pel'§)is.ti;ig 1 
concern to all levels of public scliool education, -A review of the • ' 
literature on the subjed leads" one^to believe tliat everyone is, talking - 
about it/ nearly everyone is doing sometlnng\bout it, but ho one x 
sefems to.be gQttiuj/ very far at it. * This writing^ hopef^Uy,*'will shed * 
somp light on at l^^t oi;e aspect of the problem- -measuring teacher * 
reactions to.instructionat mMerdals--and help point the v/ky to .more 
productive research. ^ 

' The Problem ^ * . • ; 

' Efforts to involve-. teachers in thejgj^uation of instrucfifOn^l . 

materials have focused^ for thejm^tpart, on gfetting teachers to record ^ 

their reactions to a' gi.veipmaterial oii some type Of "niatlsrials evaluation", 

form. Typically^^^g^ng usefid.data via this, means has' been fl-aught . ' 

with-twoprevalli:n'gprobl;emsr (1) designing ari instrument that measures . • 

i^ie worth of a giy&n., material jtor instructional purposes, anS (2) getting 

user^ of instructional materials to adequateiy'cofnplete and return the 

"evaluation instrument so that the dat-a can be analyzed.^ ■ \, • 

, * A qareful-revie^ of over 30 instrumehts used throughout tife -couti^Jry i 

has revealed, a Variety of approaches to assessing the value of instructional 

materials' for educational purposes. Although all tli6 ijistruraetts are " 

common ijva^number of ways, one obvious commonality isf that they ^o . ' 

not measure the feducati'onal value, of an iTistrjictiQnal materiar. .In other, 

■.words, ,in no w^y can the dfita- ffpm suc,h- instruments be interpreted to 
• ■ » i . » ' ^' o NO- • ■ • o> •• r • 

'identify a given instructiOMarmaterial as^,"good" or 'Jpoqr'V> "effective"' 



or "ineffective, *'^as;an ai^Ltb learninfg. .Wh^t.they^aflpear to measure is. 
a teacher's perceptions of ."the value or' worth .of instructional materials 

finding has prompted a suspicious view, toward* 
.tlte accuracy of:theJprm'"inateria],s eyalua.tiqril.'; .tA more Accurate |^rm, 
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though son\cwhat clumsy, is user reaction. Indeed, we can, and do, ' ^ 
meafiure user reactions. and we are able to tio §o with same degree of , ' 
' s.opl,usticalion. The day-to-day involvement of teachers^ however, Jh 
'actually determ'mmg the value of instructional materials (i.e.', ''good', ' 
, "bad, " "effect!^; " "ineffective") does fiol appear to be a reaiity at , 
present, though the need for such is overwhelming. , ' . ° ' . • . 

Though it is possible 'to measure us ej reactioh to instructional 
materials, the'critical matter of getting teachers to record their reactions. 
. on an "evaluatiqnJ; instrument, and to get that completed instrument 
■ into the hands of those^seeking the data, is a probleiri* of perplexing and ■. 
. frustrating proportions. Typically, teachers could not car^ less about 
•the concerns for data' of those collecting "Ihe stuff. " AS o^ teacher sq 
"d*J;&espedtfally." noted on^kn uncompleted form, "I an^so damned tired 
of .filling out these roitei), irrelevant, forms that rd^atlW^ go, without thej 
^use of the material tl>rfn be faeed'with another one^of thesej" In a word, 
teachers 'See'no paTy-off for the ti me and ener gjP^ent' in providing such 
^.data. Such a ^^jItcu instance hassled teachers to view' as pupishi^^-^the 
\ task of fornmlly responding, regarding their experienoies with; instructional 
materials.' . ' " \ • . ' / .. r " ' 

- Th^Study ' '' . . '•■ t,"- • ^""'^^ 

.To investigate the dimensions of these two problems (ddsignihg 
an ms-trument^that. measures, .the worth of a igiveft .ma'terial for instruc-i 
. tibnal pu/poses, and getting users *of instructi^ohal mVterials to. adequately 
complete' and return the evaluation instrument), a two-part study was . - 
conducted! . J'irst, an item,an^lysis waa completed On'over '3 (f "evaluation" 
'\ , instruments -vnieh had be^en fcollecte,d Xrom throughout, the., nation; " It 
wa-s hoped that such an analy^ia.would reveal .the.extVnt- to wMch the ' 
■■ instrUnients in 9[uestion iWly did'^measurWt^ insC^^^ 



instructional -"materials. ' 
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The seconcl part of the'studj focused on teacher reactions to tlTe 
forms. Teachers were selected at random and interviewed regarding. ' 
their ieelings about filling out the-'maten'aLs evaluation forms. They 
•wereaskedj very simply, '*H6w do you feel about completing such materials 
evaluation forms! as those (th^y wjsre ihown^t>'pical forms) on materials 
you have used ►with your sttldenCs ' ' ^ . - 

* ... - - Item Analysis '• ' 

'* "Evaluation" iteiris tended' to fail into t\l!^ broad categories--items 
. seekiog topograi^iical data, siieh as-the type of students with who m' the 
■ material is being used, age of students, suljject'beir^ feughtV\etc./>:-ajl<l'!^ ^ 
items" seeking teachers' reactions to the materials, such as "How relevant . 
was the material for your instructional needs?" "Would you use the . , , 
material again?, " etc. The "reaction" items tended also to be dichbtotnous, 
seeking teachers' responses to the prac tical aspects «f the" material, sui^h 
.as durability, cost and ease of use^ an4_ teacher^ responses to„ the mst rue - _ 
jtional value of the materials, such as, "Is the material well sequenced?, " 
"Does it allow far appropriate practice ?, "Is the use t»f th^j3iate]N:al ., 
reitiforcing to'the children ?,' " etc. ' "fhe usual- classification of items ■ 
contained in typical "rtiaterials evaluation" form? is shown in Table i. 
As noted earlier, the results of this analysis raised grave'^oubts about 
the evaluative capacity of such instruments to identify a given instructional 
-material as.,"gqjG" Or^'^jad, " "effective" or "ineffective", for inigtructionai 
purposes*^ The overwhelming trends were toward the gathering of infoVma- 
tion ajbout the instructional setting and teachers" subjefctivei -reactions to- 
le materials. \ . . . • ' ; 



Teacher Interviews" ^-^T 

... . X • 

• ' Teacher respboseS tolqufestiortSL^r elated- to. tlieir feelings' about 
"materials evaluation" lnstrumen,ts staUli zed quickly.^ It was. amazing 
'How 'many. Siffe'rent ways teachers could inSitj.afe that they did not like. 
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CLASSIFICATION DF ITEMS CONTiUNED IN 
TYPICAL ^AT^ilIAI^s'EVALUATIO|^ FORMS: 
ANILLU^RATION' i 



Topographical 



' Type of Students 

TMR • 
Age of Student^ 
Grade Lev^l^ - 
Subject Matter 



.Teacher Reaction 



:^cti 



actical Value 



Instruttional. 




Durability 



Sequenced 



Cost 



of Us e 



Efeinforcing 



CHARACTERISTICS OF INSTRUCTIONAL MATERIALS 
• ^F MOST IMPORTA-NCE TO TEACHERS 



Practical CJiaracteristics 



■ . 1. ""Efiectiye '• . 

2. Motivating to students , 
' 3. Cost - 

4. Adaptable - ' 

5. ^Duraole- i^.^ ^ 

6. Interesting to students ^ 
Availability ^ . ^ ! ' 

8. Relevant 
^ 9. ;.Under.stan(Jabla., ; .^'.<^^ ■ 
lO* • Easy; to use 

11. Allows for student- 
teacher interaction 1 

12, Contains a teacher's : 



mftnual ; 



-Instructional Characteristics 

\ 



1. 
3. 



4 

8. 

^. 

10. 
12. 



Contains instructional 
objectives 

Tasks are sequenced 
Reinforcing to .students 
^Allows for immediate 
iee<iback ^ 
Has transfer value 



: Xi;ontentis valid^^^^. 
Allows fcuvapptopriate 
practice ; ^ 
'Reliable / r - - 

Has a^iS-R Format " * 
Disability related x 

^ Allows for ongoing, evaiur/ 
ation 

Provides a multi-senso ry' 



oapproach/to instruction 



something. An initial intent of this part of the'study was to intervijew 

2& teachers, but after 12 intprviews, it was concluded by .the author ti^at 

to pursue tlie matter further was_a waste of valuablet. time, energy, and 

resources. (I am aw'a-l-e of how unscientific this is, bat a persoh caa 

take just so much abuse. ) In a word, teachers dislike filling out such 

forms. The following are representative of. teachers' iipifhgs: "They ^> 

t^e too long. '^ ^1 selttom- know what to write.'" "They don't make- 

'Sense, " "I jnast refose to fill XDut any more-ef4hoseJlu4^gST^^ 

bother, I have more importan't things to do. " "I fill those out and that's 

the end of i^t. I tfl*ver getanjr inforifiation back to 'dfo'me any good, " 

suppose that thi^ inf<>rrriai^i^n is important, to some peopl-e^ but' it' sure ' 

isn^o me. " With feelings such a6,these, Irt'is no wonder thai sb'^few 
♦ ' • ' ' ' ' 2^ 

teachers' will trouble themselves to complete and return the forms. 

The fact that so ni'any teacher's, regarded the inst^ments as ' 
irrelevant and of no value to them prompted the author to examine the. - 
"^eXfenf T6~ wmcTi items m the Tnstrumehts' were conslstefit with what . ' , -. 
teachers regarded as important. To measure this, 37 teachers, wer^e^ 
asked to.ljst those tilings that th^y would like to know about instructiofnal 
materials, assuming, that it was possible, to get such data. Their- 
responses were compared with. those items found in existing materials, 
evaluation forms. A comparison of grouped responses jrevealed that 
only_27 percent of the items on the "materials evaluation" forms might '• 
,yield data of i-nterest to teachers. It is hardly any wonder that teachers 
refuse to trouble themselves to provide so much data for others- that 
have so little ^e^evance 'to themselves. - - ' - ' t\ ' • 

The character is.ticS '6f instructional materials which yvere identified 
most frequently as ifnpdrtant by teachers interviewed are listedlrT Table ^i. 
The list is dichotomized and each'column contains the twelve character- ' 
.istics of greatest importance. ■ - " ' 

These lists were dWived in the^JoUom First, the 

teache,rs were asked to list, separately, those prac^Cal and ijistructional 
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characteristics of instruclional materials' wTiich they "felt were of mbst . 

importance'^ to them.- ' Second, they were presented with composite lists 

of all characteristics and asked to rank them in their order of importance. 

" * -' ' ■ - • . . • 

^Each list contained the twelve most frequently -meotioned characteristics. 

*rt should also be noted that most "materials evaluation" forms solicit 

"teacher responses to most o/ these items,' but they do s.o,' typically, in 

such an undesirable way th'at the task of responding proves offensive. ^ ■■ 

This, couplQdWith re^ue^J^s for a ple(hora of other information' oi little 

or no interest" to thf teachers, compounds the prpblem to the point of- 

piaking the mktter intolerable.' . . • 

• • . .• ■ * - . • ' " ' ' " ' 

' ' " IinpQxtant Considerations " V. 

• • » . - . . V ' 

Although existing ."materials evaluation',' forms really do" not 
dele^ine th« value of materials for instructional p'orposes, and e^en " 
though teachers dislike responding to "materials evaluation" forms, 
one mus^itot assume that the reactions of teachers sibout. the instruction^ 
mat^ials they use are not valuabK and should not be. gathered. A% con- 
sumors, we appreciafe'and valu^the judgments, feelings, and opini^ 
of -(JUjf^peer^ about goods and services that are available to us. What is 
nfe^ded is a.data-gathering procedure which has integrity, is palatable to' 
"the respondent, and provides for the cycling of Ihe data back to the . ^ 
respondents in a w^y that is both meaningful and helpful. The foUowifig 

' ft 

y 

isiderations' are related 1t> that need. \^ 




" ' Teachers^ Concerns . --'^ y 

idtially, attention shoiild be given to the development'of an Jnslru- 
nient that reflects teacher concerns* Evaluation^ specialists need to 
get 9ut of their, isolated bailiwicks and find out what is in the-roinc^^ of 
ihe consumers of instnlcQonal mkterrals. , It is dbvious to the author, 
at least,' that: previous little of this has been dt^ne. • • . . \ 

- ■ ■ . ■ ' gi) ^ -^^^ ^ 



There appear to be some obvious charaQteristics of existing ' 
""evaluation'* instruments which niake them iniiiiedi^tely offensive to the , . : 
•respondqnt. First, is'length^ Multi-page tnslrumenfs are' simply unattrac- . 
tive* Pilot studies by th<^ author suggest thaJTthe shorter the instrumeat, . 
the belter; preferably. less than one full 8 1/2 xllpage in length. Secondly, 
teachers react negatively to ipstruments. that require written response's/" 
If it is at all possible, and there is every reason to believe that itjs, 
thQ' teacher shbuW be^able ta -respond by dieckin^items*" listed. . Allow- 
anceis should bcf rfiade for opea-ferided responses, iLthe ite^is listed were 
not adequate.., A written response is both physically and mentally^ iring,' 
is time-consumir^, and is often so ambiguous as to be useless to the 
evaluator. A third characteristic of instrument.design wliich oan/'*turn 
teacher.^ pff, " and wliich requires careful 'coasid.|rati^h^4sgene^al 
ance. '^A neat, typeset^ easy-to-read, easv^^t oi-look-mjg st^ 
that is quickly ''^si zed up" by the respondent and, seen as non-threateniijg 
appears on the basis of initial field testing more likely to be completed 
,and returned by the respondent. ^In this regard^t was interesting to note 
that sojne teachers viewed the "evaiiiation instrument" in much the same 
light as they view^ed an examination, suggesting that care be taken to make 
sure tliat the format of an ifistri^m^t be designed t;o avoid its being 
confused with a test. Lastly, teachers appear to react negatively to 
instruments. that contain numerous items. In fact,* there is evidence to 

suggest that more. than 10 or 12 items are. too many. While field testing 

-'**•"■ 

rone instrument, for example, every item to which a teacher might have 
Responded was number'^ti„ and totaled 52. When. teachers saw the number 

^52, they tended , to grow weary immediately^ even'tfiough the- instrumfent 
was no largei* than amIBM punch card^ The ihstraaient was, re-designed^ 

, items were group^cd into 10 areas and only the areas were* numbered (see / 
Figure 1). Under these circumstances, the instrument was much niore 
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acceptable, ,eyen though the task for the teacher and the size of the inst^ui 
ment, remained exactly the same as before. - " ^ 



Data;Cd'ftection Vracedures 



V 



4 



There is probably nothing: that can be said with -more cei*tainty about 
teacher reactions to data- gathering instruments than that they loathe the' 
'4.sk of repeatedly filliiig, out a,form every time they use instructional 
materials. And yet this is what the^y^re repeatedly asked to do. To deal 
with. this, a simple research procedure is showing promise. Over thr^e 
randomly selected periods of time during- th6 schootyeaiLitwo weeks, *dr 
10 consecutive school days), one for each nine- week school session, . _ 
teachers are being asked to complete a Materials ^^se Response Card on 
each material they use only during the three selected periods. Under 
these conditions, they seem to be' more willing to cooperate, knowing that 
they will not have to shoulder this^Jjurdeh indefinitely. It would be assumed 
■that suctr a procedure would yield less data, but this does not appear to be 
the cas^e^ over the long .run. Rather than a lot of data> coming in at the time 

' an evaliiatiori procedure is initiated, but then falling off drastically ovei* 
time, as huppens with- continuous data-coll6ctibn procedures, an intermittent 
data-gathferifig schedule seems to encourage a higher response rate oyer . 
8hort4)eriods'or.time, ais. illustrated in Figure 2. Over long pefiods^ oi 
time, three to' four yeai*s, it seems obvioys th-at randomly selected , 

* samples of data woxdd yield a pattern of responses t^at would be^ highly • 
representative of the, population, and would be useful in aiding teacher!" 
in the seleptioii ofinstructional raaterials. ' ' 



•Feedback to Teachers- 



' observed .earlier, a common^ complaint of teachers, is that their^ 
involvement, in ^'jiiaterials. evaluation" is one-way, and that*is away f ro ni ' 
them.* It is'proposed, therefore, whei]Lieachers are agkjed to provide data 



• " ^Figure 2 ,. ^ - --^-^ <^ 

IULI^STRAtED RESPONSE RATES OVERjriME, 
• /using CONTINUOUS 'AnId rtN'TERMITTENT ' " ■ 
DATA-GATHEFIING SCHEDULES 
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about their experience with instrup.tionaL -materials, that-they be assured 

. , •••.*'• y 

that their responses, and those'of their peers,' will be routed back to . 

i^em in a way that will aid them in their task of selecting. ^ppr opiate • 
materials for their instructional riefe^ai-'8^^Mlypi^tis°3a^ of rapid' 

i computerized da,ta analysis, thefe is n^^-^ tp/^he resourds available 
Ito serious evaluation specialists in1he accomprishmentof such a task. 

. ' .. - Teacher Use^f Data 

• ■ • X* - 
Although teachers expr-esS an interest in receiving feedback about 

peer responses tb instructional materials, and although there* iS'.reas on ' 

to sugpst that such feedback can 'Ufe provided in an understandable and 

cogent way, we are still' not -sure that -once 'teachers have such data that 

they^'caa or will' use those data to iriodify their interaction with in'struc- 

'ttbnal materials._ Ltttle is known about the .dynamics involved^ in the 

deeisipn- making processes of teachisrs,^ and before fe.edback abotit 

instructional!. materials can be meaningful^ it appears that more needs 

to.be known about these processes. - ' ' ' - " 




* " ;• - ' Conclusion 

It i9 a phenomenon that in this era of Naderi^ed cdnsunier pirotec- 
tiori» at a time when teacher^Nare bombai-ded as^never before with . 
appeals and advertising pitches iro;n scores of publishers to buy their . 
tens of thousands of materials, that so little is said, and less is known 
about the {iQ.cume'nted instructional w^rth of products. What we need 
•is a "go(^ scfhoolkeepers seal of approval" stamped on each instructional ' 
material after it has; been determined to te fi^d-worthy and psyqhologieally 
as well as physically safe fdr. students. • • ° . .• 




OF LRc servi6es;- 



lographic Informatioiy 



0, v« . 



2. Name of School 



Zip Code^ 



* 4.* Check' '^ail of the following' that apply to you 



Regular Class Teacher 



5 Resource Room Teacher 



Special Class Teacher 

I tipef ant/Consul ting Te^acher 



College Faculty 



9 ^ 



College ^Student 



4 Ancillary/Support Teacher 



Other 



S5ecify_ 



Spec if y_ 



Scliool placement or grade level of, your class. Check al], that apply. 
. Preschool ' Senior High * . ' 



J>rimary & 



Combination 



^^Intermediate 
jJUnior Hig^ 



Specify 
Othqr 



S|)ecify__ 



J Type an4 nximber handicapped children wit^- whomiyou work. 



-EMR 



@}hysical'ly Handicapped 



'Speech Impq^ired 



TMR 



- Visually Impair ecJ 



_AuditorialLy Impaired 



Ho sp i t^ 1 i zed/Homebq und 
Other , 



E.D. 



Multiply Handic'apped *^peci*f y • \ 



' ' • . 'a. Patron Awareness of- Center Services 

A*re you aware of. the '^^vices 'available to you through the lAC (ALRC) in- 
'your^area? ' % ^ ' / «• /' \ . « 



1^ 



No" 



4 - ■feag.e^aB^rL. 



3 a 



,2., ypw-wece^fehe ^center services br<)ught to youi? attention? *Check all th^t 
apply. * \ • r ' 



"School administration' 



A 0 •» 

LRC Fer^nnel "V^^ 



A nci3aary/,Si;p^rt ff^rsonnel 



Brochures^ 



pisplays 



College Course's- 



Other Teachers 



Other , ^ 



Workrshops 

V 

Newsletters 



Specify 



C. On-site Assistance 



1.. HOW many times 1:hi^ sqJiooI ye^r has scnecne from. t;he, Center come to your, 
oiass/sqhool^ to assist 'yo^? ' , " • 

If non^, why? > 



2i Which:: of the following services were deliveredi' 

^ t daterials Demonstration * • . ^ 

• * ^Individual Student Programming 



Student Assessment 



_^eh^vior M^nageLent and 
Classroom, Control 



Material^ bevelopmeot- ' 



• Materials Loan 



Materj.als Selection 




jDther 
Specify 




3. Wnat are y0u ^oing differently in your classroom as a result of thife service? 



4. . TO what 'extent did you find .the%^ services usefijX? 



1 

Not At 
All. . 




^ *' Somewhat 



5u . .Which' service' V as most useful? 



Quite' 
Useful 



.5 ' 
USef-ul. ^4 



^ vjhy was it tno^ useful? j/- ^ 



6. Which seryiofe wa^. least usefcui?. ^ 



t 0 



*Why was.it least useful? ^ 



c • 




. D. InrQ^riter Assistance ; \ | 



'1. How many times this school year have you visited the center? ' / — 
^ -if none/ why? ^^^^ - 

-^Whidlgbf the following services did you receive at ^the center?.^ 



Wterials Dem6nstr^tior\ 



' BehaVior Management, and * 



Classroom Control 



Individual Student.. Programming 

. I. ^^^y^ '' ' *' * * 

Student Assessment*^/. ^ 



^Maiterials Development* 

/4. 



Materials Loan 



^ Other ' 
^ 'Specify 



Materials Selection 



What are you dbing* differently in youi: classxpom as a resul^t these 



• 4j I To what extent did you find these services useful? 



37. X 



--r;-"- -2- -3 T,'.:4-' -'-5- 

Not At-- Very , Somewhat Quite Very 

Ali ■ *. * Little ' o . .' Useful Useful 

,5-. Which, servifee was n^ost useful? f - ^ a' ' 



Ttutj wao X u jUitwo c (.OCX ux • * 
















• 




• • . • - . * ■ , 

6. ^ Which service was 'least useful? 










\ ^ . 










,' ' ^ ' / ^ ' . . 
Why it leas^t useful? • , - • 














«• — 




- ^ «. 












— . T 










E.' * Materials Loan 











• How many times during .this school year have .you borrowed mater j^als from the 
• LRC?. ' ^ . ' - 



t f ■ If none, why? 



2. Whichr of the inateriaXs you borrowed , did; ypu find most useful? If possible; 
' * .identify theoa by name. ' . * . ' * * ' ^ 



r 



V 
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« - 

- 1- 



4t 



'3, Which of the 
'. possible^ 




ials you borrowed did you* find least useful? 
Ey-^Jbhem by^iiame • , ^ _ ' 



If 



^1 



4. What perc^t (or how many) of the materials you requested were available 
to you on the /date yoii wanted them? ""If necessary, please estimate. If 
yo.ur answer is stated as a percent, so indicate. _ 



5. What percent (or how many) of the materials you requested were available 
to you within '2 weeks of the date you wanted them? If necessary^ please 
estimate. If your answer -is stated- as a percent, so' indicate. 



»6, What percent .(or how many) of the materials you requested were available 
-to you- later^ than two weelcs of the date you .wanted them? -If necessary, 
please estimate: 'If your answer is stated as-a'perce^tt* so indicate. 



,7. To what *fex'tent did-you find materials* loan services i^seful? 



1 . ^ 2v I 'a . >/ ' K 

Not* At ' Very ^mewhat - "ijuite ^ ^ 

. All * Little ' ' ' • * - * ' ' Useful, Useful 

• / . - . . . ^ ^ , . ■ • ^ ' / . 

If .1,« 2, oY* 3, please explain, why. ■ ^ 



F.. InfOOTation Services - " . ' 

How. many requests for information havp you^made of the LRt'this school y^ar 
(sjuch'.as , information about educatibnai d^agppsis ,^ educational pr^scrip^piTh^ 
eaiiGfttional programming; media' and materials, etc.)?' - 

What percent (or how many) of thes.e ,r:equests -did you feel received, an 
adequa't^^espohse? "'If stated" as a p^centA'Sia Indicate. ' ^ - 



3, If thi^LRC has been *anable to fill your requests for information/ have you- 
been referred to otl^er agencies or individuals fox a<3di*tionar help? 

Yes No . . . . - , . 



If yes/ where and: for what information? 
• Where.-* 



Wh.a£ Information 




4*^ 'v^iic^h of the following ^informational mailings haye you repeivedf during this 
* school year? ^ ■ . * ■ ^ ' .. ' - . " ^ - 



/ , Brochures 



LRC Newsletter, 



JVLRC/RCq- News letter , " 
Other 



State Newsletter 



Specify 



rDo you-read -them?— Yes 

If NO/ .please -explain why not- 



No 



5^ What B.cti.on^-have-yQb taken a$ a result of informa.tion received* from these 
mailings?. * v*. ' ' • ' * ' . - . , " 



— , . — ;-. . , ' — — - ■ 

7^ J To what'ex^-ent did yoii fin4 infonrfation services useful? 

Not At;" . '''•/;v ,Very^ - ' Somewhat* ; " * "Quite * ' \ .Very ' \ 
' '•-'AjLI*--* . ^Littlp * ^ 1- ' Usefur * • ^ Useful - 

If 1,^2, 'or "^S, please explain why. . ' - . - . • : - 



' Gr In-'Service Training 

1. Whit workshops 'sjponsored by the LRC have^you attended during this s'chbbi 
year? * 



2. What aire you doing dif f e'lqently with your students as a ^es\jlt of the 
^ \;know^edg^/s\ill> -ehat you acquired*- f roin the vork^hops ;you 




3, If you are a studenti how haVe -you used the servi^ces .of .the LRC in puirsuit 
of your -studies? ' ,v - 

./ - - Evaluating "Materials , ' ' C ompleting. Co torse Assignment - 



;^_pev_elopjLng ..Materials ; ^*_,,,,..,^Writijag^,Ter^^ 



Developing Educatiorf- Pjco^rams .B 6rroving>jlaterials for Use 

' '[i. . ' ' ...^ . ^in Student Teacrhing/Practicum 

J^ssessing Student ^Progres^" ' ' . , ' ^ 



4^ To what extent , did you fjjid irt-service training -^^rVices useful?- ,^ 

J^te; ^ 



^ ' No€ 'At ' V V . / Very ^^"^ • ^ Somewhat*" ' " * - - 



All ^ Littl^e,; * 7 V /UpefiSl'^' ^ Useful 



. _ If ;1, 2^ oj> 3, please^ explain wh^. 



> 1 



c 



HV- ^'General Reactions - - . , - ' ' - . 



1^;. Are -tire services offered l?y the llfeC available -from any othdr /source? , 
• . Yes -N o ^ . ' . / 



41, 



li. yes, where and what services? 
Wfiere 



What Services 



If the ^ack of time, money, and personnel were not problans, what 
additional -seiTvices, pr ^changes 'in existing services^ would you want? 



f 



.<:; 
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47^ 



National Evaluation Opmmitttt 



Eaeri(us Ptofessor . \ 

University of Chicago 

lichen D.itn 

Past Ptuswjcnt ~ 

National Educahon /^s5octahon 

Lyle Bourne* 
Ptofessot 

University of Colorado 
Sue Buel . 

Consultant, Pottland, Ote|ton 
Roald Campbell 
£ji>ef)tus (ptofessor 
The Ohio Slate Univctsity 
George -Dicksort * 
Dean. CoUej^e of Education 
University of Toledo 



Professot 

University of Illinois 
Chester W Hanis 
Professor 

University of Cahfunui • Santa Barbara 

William C.Kalzenmcyet 

Professor 

Duke University 

Barbara Thompsbo 

Superintendent of Public Iristruction 

Stite of Wisconsin' 

Joanna Villiams 

Professor * 

Teachers Colleje 

Columbia University 



University Advisory Commiftee' 

John'R Paln»er. Chairman ' 
Dean 




" -SchddrorE3uc3lion » 

Will lam R. Bush 
J , Deputy Director 

H & D Center 

^ DaVid E Cronon 
Deatfi 

Collete of Letters and Science / 
Diane {} Eich ' . / 
Specialist , ' / 
R&D Center 

Evelyn L. Hoekcnga v 
' Coordinator * 
^R «rp Cenler*'"> - — ~ - 

Date D Johnson 

Associate professor^ 1 
Cumoilum and Instruction ^ 
HeAert /. Klaujrocier. 
Menber of Jthe Asspciafcd Faculty 
^ R&D Center 

'Associated Faculty* 

• Vernon L Allen , ' 
Professot 
psychology 

B. Dean Bowles ' < 

Professor ♦ 

Edt^tional Adn^inistration 

Thovas P. Carpenter 

Assistant Professot . » 
/ Cumculum and^strucd^ 

Marvin J. Ftuth . 
" Ptpfe»SK 
, Educational Admini^ration 

John (5. llatwy 

l^tCessot 

Malheimitict > \ 

CMrScuUidi and Instruction ^ 
Flank jr. Itoopcr: , ; - ^* 

Qiil(^Develo(Ni4nt i, 
. Herbert J. Klnusmeiet 
y.A.C HchiDon* Professot 
Educational Psycho]o|or 
JaWfh T. LavHoa 
AMit^At Proiessoc 
;EAicMion(il Tsycholnfty 



cr of tlie Associated Faculty 
R&D Center 
Wayne R Otto 
Associate Directot 
R & D Center • 

RjchardA Rossmiller 
Drtcctof 

R&D Ceater ^ 

Elizabeth J, Simpson 

'^Dean * * — - 

- School of Family Ri^tces 

t *and Consumer Sciences 
* 

Len^Van Fj^s 

, Associate Vice Chancellor / 
Univenity of Wisconsin • ftladiswi 




. Joel R. jjevin ^ " 
Professor 

Educational Psychology 

L. Joseph Lins 

Ptofessor 
/ Institutional Studies 
. James M Lipham 

Ptofessor 

Educational Administration 
* Donald (kl^lsaac 

Professot 
' Educational Ada)ini8tratidn 

' Gerald Nadler 

PtofcsiK>t * 
IftdustrUil Enginc cting 
Wayne R. Otfo \ .PTZ^^ 
Professot t * , 
^ Curriculum and fnstniction 

^ Robtrrt C Pctzold 

^ Music, *. 
CuiiicMlum an^ In'sltuctign' ' 



Ihomas S. Popkewitz 
Assistant Piofesso^ 
* CunicutuA and In;rtfuction 
Thomas A. Romberg \ 
Profe«sot ^ 
Coniculum and InstttKtion 
Richard A. RossmxllA^ 
Professot . , 
Educational Administration 
Dennis W. Spock 
Assistant Ptofessot 
Educational Adinintsttation 
Michael J. Subkovik 
Assistant Ptofrsspc 
EduC;^ional Psychology* 
Richatd U. Venezky . 
Professot 

^ ' Coaiputer Sciences 

'.J.,Fied Weaver 
PtoCessot 

CunicuUtm and Instruction 
. UrtyMVildeg. 

Assistant Ptofessot 
. Child Development 
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